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ADAPTIVE TCP DELAYED ACKNOWLEDGMENT 



BACKGROUND OF THE INVENTION 

1. Technical Field 

This invention generally relates to reception and transmission of data over a 
network. More specifically, this invention relates to adaptive Transmission Control 
5 Protocol (TCP) delayed acknowledgment. 



2. Background Art 



The development of the EDVAC computer system of 1948 is often cited as the 
beginning of the computer era. Since that time, computer systems have evolved into 
extremely sophisticated devices, and computer systems may be found in many different 

10 settings. Computer systems typically include operating system software that controls the 
basic function of the computer, and one or more software applications that run under the 
control of the operating system to perform desired tasks. For example, a typical IBM 
Personal Computer may run the OS/2 operating system, and under the control of the OS/2 
operating system, a user may execute an application program, such as a word processor. 

15 As the capabilities of computer systems have increased, the software applications 
designed for high performance computer systems have become extremely powerful. 

Communication between two computers or processes is facilitated by standard 
protocols. These protocols establish uniform means by which a sender can reliably 
transmit information to a receiver. However, the protocols establish the fundamental 
20 structures of communication, not how to optimally use them. Transmission Control 
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Protocol/Internet Protocol (TCP/IP) is one such inter-process/inter-computer 
communication protocol. 

Within the TCP/IP protocol suite used throughout the Internet, the Transmission 
Control Protocol (TCP) provides reliable end-to-end delivery of a stream of bytes over a 

5 network connection. Applications such as Hypertext Transfer Protocol (HTTP), File 
Transfer Protocol (FTP), and Telnet use TCP to reliably send and receive data over IP 
networks. The design of TCP includes an acknowledgment (ACK) scheme to guarantee 
that the data sent from one end of a connection is actually received by the other end. If 
the sender does not receive an ACK within a calculated time period, it will assume the 

10 data has been lost and retransmits the data. 

In order to gain efficiencies both in network utilization and protocol processing 
overhead, the TCP standard provides for what is known as delayed ACKs. Delayed 
ACKs are important because the sender may transmit multiple segments of data, called 
packets, before a required ACK period lapsed on an earlier segment. The basic idea 
1 5 behind the delayed ACK strategy is that by not immediately sending an ACK for each 
packet received, it is possible to combine acknowledgment of the receipt of multiple 
packets into a single ACK. 

Another means of reducing ACKs arises when applications that receive data 
quickly turn-around and send data back in the other direction. This situation allows the 
20 receiver to combine or "piggyback" an ACK with the data to be sent back thereby 
reducing protocol processing overhead by reducing the total number of packets to be 
processed. 
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For certain traffic patterns there are definite advantages when using delayed 
ACKs. However, for other traffic patterns the delayed ACK introduces 2 primary 
problems. First, delayed ACKs can introduce an unnecessary delay in the flow of data 
resulting in reduced throughput rates. According to the TCP standard, an ACK should 

5 not be delayed by more than 500 ms and, in fact, most implementations use a 200 ms 
maximum delay. In a one-directional bulk data transfer, introducing these 200 ms delays 
throughout the transfer can have a significant negative impact on the throughput realized. 
This is especially true when the sender does not anticipate receiving delayed ACKs. In 
such a case the sender may delay the entire length of proscribed time and then resend the 

10 data before an ACK is received. This introduces a large amount of delay and additional 
traffic in the communication channel 

A second problem introduced by using delayed ACKs is that a potentially 
significant amount of processing overhead is introduced to set a time-out timer and on 
timer expiration, to send the delayed ACK. 

15 The net effect is that there are conditions where delayed ACKs enhance 

communication throughput and conditions where delayed ACKs inhibit communication 
throughput. What is needed is a system and method that overcomes these problems. 

DISCLOSURE OF INVENTION 

Therefore, what is needed to overcome these problems is the present invention 
20 which adaptively detects when delayed ACKs enhance or inhibit communication 

throughput, and adjusts the use of delayed ACKs to maintain an optimal communication 
throughput. 
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When communication between two processes commences, an embodiment of the 
present invention presumes that delayed ACKs will enhance communication throughput 
and enables use of delayed ACKs. Enabling use of delayed ACKs means that until 
conditions indicate that delayed ACKs will inhibit communication throughput, an 
5 embodiment of the present invention will attempt to use delayed ACKs for all data 
packets received. Disabling use of delayed ACKs means that until conditions indicate 
that delayed ACKs will enhance communication throughput, the present invention will 
send an ACK for each data packet received. 

In order to determine when delayed ACKs will enhance or inhibit communication 
10 throughput, an embodiment of the present invention monitors certain traffic conditions. 
One condition monitored, when use of delayed ACKs is enabled, is the amount of time 
between receipt of a packet and the time when an ACK is sent for that packet. If a 
predetermined time period expires before the receipt of another packet, then use of 
delayed ACKs would not enhance the communication throughput and use of delayed 
15 ACKs is disabled. 

Another traffic condition monitored, when use of delayed ACKs is disabled, is 
when the receiver is to reply to the received packet with data. The difference in time 
between the reply of data and the previous ACK sent is compared to a predetermined time 
period. If the time difference is less than the predetermined time period, then the use of 
20 delayed ACKs is enabled. 

Another traffic condition monitored, when the use of delayed ACKs is disabled, is 
when two data packets are sequentially received. The difference in time between the 
receipt of the current packet and the previous ACK sent is compared to a predetermined 
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time period. If the time difference is less than the predetermined time period, then the use 
of delayed ACKs is enabled. 



The foregoing and other features and advantages of the present invention will be 
apparent in the embodiments of the present invention, as illustrated in the accompanying 
5 drawings. 

BRIEF DESCRIPTION OF DRAWINGS 

The embodiments of the present invention will hereinafter be described in 
conjunction with the appended drawings, wherein like designations denote like elements, 
and: 

10 FIG. 1 is a computer system in accordance with an embodiment of the present 

invention; 

FIG. 2 is a computer network with at least two computers in accordance with an 
embodiment of the present invention; 

FIG. 3 is a flow chart describing the methods of enabling and disabling the use of 
15 delayed ACKs in accordance with an embodiment of the present invention; 

BEST MODE(S) FOR CARRYING OUT THE INVENTION 

The embodiments of the present invention solve the problems described in the 
Disclosure of Invention by adaptively detecting when delayed ACKs enhance or inhibit 
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communication throughput, and adaptively enables or disables the use of delayed ACKs 
to maintain an optimal communication throughput. 

Turning now to FIG. 1, a computer system 100 in accordance with an embodiment 
of the present invention includes N processors 1 10 through 1 1 1 , a main storage 120, an 

5 auxiliary storage interface 160, a network interface 170, a Direct Access Storage Device 
(DASD) 180 used for example with a read/writeable medium such as floppy disk 190 or a 
compact disk, a bus 140, and a memory 130 that includes multiple locations for 
containing various software programs and data. In this example, memory 130 includes an 
operating system 131 and an acknowledgment adjuster 132. These memory items are 

10 discussed with reference to other figures. 

Processors 1 10 through 1 1 1 perform computation and control functions of system 
100. All processors associated with system 100 may each individually comprise a single 
integrated circuit, such as a microprocessor, or may comprise any suitable number of 
integrated circuit devices and/or circuit boards working in cooperation to accomplish the 
15 functions of a central processing unit. All processors are capable of suitably executing 
the programs contained within memory 130 and acting in response to those programs or 
other activities that may occur in system 100. 

Memory 130 is any type of memory known to those skilled in the art. This would 
include Dynamic Random Access Memory (DRAM), Static RAM (SRAM), flash 
20 memory, cache memory, etc. While not explicitly shown in FIG. 1, memory 130 may be 
a single type of memory component or may be composed of many different types of 
memory components. For example, memory 130 and processors 1 10 may be distributed 
across several different computers that collectively comprise system 100. Computer 
system 100 of FIG. 1 simply illustrates many of the salient features of the invention, 



ROC9-2000-0202-US1 



6 



without limitation regard to the physical location of Processors 1 10 or memory locations 
within memory 130. 

Bus 140 serves to transmit programs, data, status and other forms of information 
or signals between the various components of system 100. The preferred embodiment for 

5 bus 140 is any suitable physical or logical means of connecting computer systems and 
components known to those skilled in the art. This includes, but is not limited to, direct 
hard-wired connections, fiber optics, infrared (IR) and other forms of wireless 
connections. It is anticipated that many alternative methods and material for connecting 
computer systems and components will be readily adapted for use with the present 

10 invention. This would include those methods and materials not presently known but 
developed in the future. 

Console 150 allows human users to communicate with system 100, normally 
through a workstation 155. Workstation 155 may be a computer system such as a 
personal computer. Although system 100 as depicted in FIG. 1 contains only a single 
1 5 workstation 155, it should be understood that the actual number of workstations attached 
to system 100 will be a function of system design and user preference. Workstation 155 
may also be a dumb terminal or other non-programmable computer input/output device 
which allows human interaction with computer system 100. 

Auxiliary storage interface 160 represents any method of interfacing a storage 
20 apparatus to a computer system known to those skilled in the art. Auxiliary storage 

interface 160 allows auxiliary storage devices such as DASD 180 to be attached to and 
communicate with the other components of system 100. While only one auxiliary storage 
interface 160 is shown, the present invention anticipates multiple interfaces and multiple 
auxiliary storage devices such as DASD 180. For example, DASD 180 may be a disk 
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drive which is capable of reading and writing programs or data on a disk. DASD 180 
may also be any other type of DASD known to those skilled in the art. This would 
include CD-ROM drives, hard disk drives, optical drives, etc. 

Network interface 170 is used to connect other computer systems to computer 
5 system 100 in networked fashion. One particular networking configuration will be shown 
in FIG. 2. The present invention applies equally no matter how computer system 100 
may be connected to other computer systems and/or workstations, regardless of whether 
the connection is made using present-day analog and/or digital techniques or via some 
networking mechanism of the future. 

10 It is important to note that while the present invention has been, and will continue 

to be, described in the context of a fully functional computer system, those skilled in the 
art will appreciate that the mechanisms of the present invention are capable of being 
distributed as a program product in a variety of forms, and that the present invention 
applies equally regardless of the particular type of signal bearing media to actually carry 

15 out the distribution. The program product tangibly embodies a program of machine- 
readable instructions executable by a computer system having an operating system. The 
program product, in combination with a computer system, directs the computer system to 
perform the embodiments of the current invention and any steps taken by these 
embodiments. Examples of signal bearing media include recordable type media such as 

20 floppy disks (e.g., disk 190) and CD ROMS, and transmission type media such as digital 
and analog communication links, including wireless communication links. 

FIG. 2 represents an embodiment of the invention where System A 210, which 
contains the acknowledgment adjuster 21 1, is connected to the Network/Internet 220. 
System B 230 is also connected to this Network/Internet 220. As illustrated by 
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Connection 240, System A 210 and System B 230 have established a two-way 
communication connection between them. Thus, Connection 240 represents a flow of 
information between System A 210 and System B 230. This flow of data includes, 
among other things, data packets and the ACK of data packets. 

5 For purposes of FIG. 2, assume that System A 2 10 has requested information from 

System B 230 and the appropriate communication connection 240 has been established. 
Further assume that System B 230 has commenced sending the requested information 
through the Network/Internet 220 to System A 210 over the communication connection 
240. While not a necessary condition for the invention, assume also that System A 210 

10 commences by assuming that delayed ACKs will be used. 

As the first data packet is sent over the connection 240, System A 210 will delay 
its ACK so that it may be combined with an ACK of a subsequent data packet. Because it 
is not necessary for System B 230 to wait for an ACK of a first data packet before it can 
send subsequent data packets, System B sends a second data packet before receiving 

15 acknowledgment of the first data packet. If System A 210 receives the second data 

packet within a predetermined amount of time, System A 210 acknowledges both the first 
and second data packets with a single ACK, thus employing the concept of delayed 
ACKs. If System B 230 receives the ACK of the first and second data packets within a 
specified amount of time, System B 230 does not need to resend those packets. Thus, 

20 data traffic is reduced and throughput is maintained at a high level. 

If System A 210 had not received the second data packet within the predetermined 
amount of time, System A 210 would have replied with an ACK for the first data packet 
to System B 230. System A 210 would also have changed an internal state such that 
delayed ACKs would be discontinued until future conditions indicate that they would 
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prove advantageous and ACK would be made immediately after receipt of a data packet. 
By immediately responding with an ACK for a data packet, System A 210 ensures that 
System B 230 receives the ACK before System B 230 assumes that the data packet was 
not received and re-sends the data packet. This prevents unnecessary data on the 
5 connection 240 and yields greater throughput. 

When System A 210 is responding immediately to each received data packet, i.e. 
not using delayed ACKs, System A 210 monitors for conditions where it would be 
advantageous to use delayed ACKs. If System A 210 receives a data packet within a 
predetermined amount of time of a previous data packet, System A 210 sets an internal 
10 condition which causes it to use delayed ACKs for all subsequently received data packets. 

Those skilled in the art will recognize that this invention applies equally if there 
are more than two computers connected and would equally apply over any type of 
networking environment. Those skilled in the art will further recognize that while in this 
example System B 230 does not have an acknowledgment adjuster, System B 230, as well 
15 as any other computers connected to the network, may contain and make use of an 
acknowledgment adjuster. 

FIG. 3 is a flow diagram on how the acknowledgment adjuster adaptively adjusts 
the use of delayed ACKs. The application of the flow diagram in FIG. 3 assumes 
conditions similar to those described in relation to FIG. 2, namely that a communication 
20 connection, such as connection 240, has been established between two systems, such as 
System A 210 and System B 230, that System B 230 has commenced sending data 
packets to System A 210, and System A 210 is using the acknowledgment adjuster. For 
purposes of the discussion of FIG. 3, each numbered item will be referred to as 'Step' 
followed by its number. This will be true if the 'step' is a rectangle or diamond. To 
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understand the diagram it is helpful to generally see the rectangles as discrete processing 
steps and the diamonds as decisional steps. Step 301 represents a initial, default step of 
enabling the use of delayed ACKs. Those skilled in the art will recognize that other 
embodiments of the present invention may initially disable the use of delayed ACKs. 
5 Step 302 stores the current time as the last acknowledgment time (LastACK). The 

purpose of Step 302 is to enable the acknowledgment adjuster to operate properly as the 
first data packet is received. 

Step 303 represents a period of time when a system is able to receive a signal 
indicating a data packet has arrived, a delay time has expired, an outgoing response is 
10 ready to be sent, or some other communication event. Those skilled in the art will 
recognize that this 'step' does not require that the system remain idle until an event 
arrives, but the system is able to perform other tasks which may be scheduled within the 
system. When an event is received, the system proceeds to Step 304. 

Step 304 represents a decisional box which determines whether a received event 
15 was initiated by a delay timer. Whenever a delay timer event is received, that event 
indicates that a data packet was received, that the use of delayed ACKs is enabled, and 
the data packet has not yet been acknowledged. TCP/IP requires that a data packet be 
acknowledged within a specified amount of time or the sender of that data packet must 
assume that the data was lost and needs to resend that data packet. In order to prevent 
20 multiple copies of the same data packet being sent over the network when the use of 
delayed ACKs is enabled, the present invention sets a delay timer after the receipt of a 
data packet. If the delay timer expires, it sends a delay timer event to the system which 
will force the system to send a ACK within the time period allowed to acknowledge that 
data packet so that a duplicate data packet will not be sent. When an event is initiated by 
25 a delay timer, the acknowledgment adjuster will proceed to Step 305 where the use of 
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delayed ACKs will be disabled. Step 305 represents the step of disabling the use of 
delayed ACKs. Step 306 stores the current time as LastACK and then acknowledges any 
data packet which has been received but not acknowledged. 

Step 307 represents a decisional box that determines whether the received event is 
5 a data packet. If the event is the receipt of a data packet, the acknowledgment adjuster 
will proceed to Step 308. Step 308 represents a decisional step to determine whether the 
use of delayed ACKs is enabled or not. From Step 308, the acknowledgment adjuster 
proceeds to Step 309 if the use of delayed ACKs is disabled, or to Step 31 1 if the use of 
delayed ACKs is enabled. 

10 Step 309 represents a decisional step to determine whether the time difference 

between the receipt of the current data packet and the last acknowledgment time, 
lastACK, is greater than a predetermined time period, predetermined time period 
represents is the measure against which the acknowledgment adjuster determines whether 
to enable the use of delayed ACKs or not. If, in Step 309, the amount of time is greater 

15 than the predetermined time period, the acknowledgment adjuster does not enable the use 
of delayed ACKs, but proceeds to Step 306 as described above. If the amount of time is 
less than or equal to the predetermined time period, the acknowledgment adjuster 
proceeds to Step 310. Step 310 represents the step where the acknowledgment adjuster 
enables the use of delayed ACKs because the amount of time between the receipt of the 

20 current data packet and the last acknowledgment time, lastACK, is less than or equal to a 
predetermined time period. The acknowledgment adjuster then proceeds to Step 306 as 
described above. Those skill in the art will realize that in another embodiment of this 
invention the acknowledgment adjuster could also proceed to Step 313 and delay 
acknowledgment for the current data packet rather than waiting for the next data packet to 

25 begin use of delayed acknowledgments. 
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Step 311 represents a decisional process to determine whether a delayed timer has 
been started. To arrive at Step 3 1 1 the event must have been a received data packet and 
the use of delayed ACKs is enabled. As described above, a delay timer is started when 
acknowledgment of a data packet has been delayed. The acknowledgment adjuster 
5 proceeds to Step 312 if a delay timer has been started, otherwise to Step 313. In Step 312 
the acknowledgment adjuster clears the delay timer. This delay timer will not be needed 
because the acknowledgment adjuster then proceeds to Step 306 where the current and 
previous data packets are acknowledged. This combining of a previous data packet 
acknowledgment with a subsequent data packet acknowledgment is one example of a 
10 delayed ACK. Step 313 represents the step within the acknowledgment adjuster where it 
has determined that acknowledgment of the current data packet will be delayed. Thus, a 
delay timer is started, set to expire in a predetermined time period unless a subsequent 
data packet is received or an outgoing response occurs before the expiration of the delay 
timer. 

15 Step 314 represents a decisional step to determine whether the event is an 

outgoing response data packet. If the event is an outgoing response data packet, the 
acknowledgment adjuster proceeds to Step 315, otherwise it proceeds to Step 319. Step 
315 represents a decisional step to determine whether the time difference between the 
current time and the last acknowledgment time, lastACK, is greater than a predetermined 

20 time period. If the time difference is greater than a predetermined time period, the 

acknowledgment adjuster proceeds to Step 318. Otherwise, the acknowledgment adjuster 
proceeds to Step 316. At Step 316 the acknowledgment adjuster clears the delay timer if 
it exists. The acknowledgment adjuster clears an existing delay timer because a delayed 
acknowledgment will be combined and sent with the outgoing response data, which 

25 represents another example of delayed ACKs. The acknowledgment adjuster then 
proceeds to Step 317 where the use of delayed ACKs is enabled if it is not already 
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enabled. Step 318 represents the step of saving the current time as the last 
acknowledgment time, combining any delayed acknowledgment with the outgoing 
response data, and sending the outgoing response data. 

Step 319 represents other events which may occur within the system but are not 
5 handled by the acknowledgment adjuster. 

As shown in the previous examples, the preferred embodiments of the 
present invention describe apparatuses and methods for adaptively adjusting the use of 
delayed ACKs to achieve more efficient communication throughput. Certain traffic 
conditions are monitored which cause the Adaptive Program to either enable or disable 
10 the use of delayed ACKs. When use of delayed ACKs is disabled and by monitoring the 
network traffic the present invention determines that delayed ACKs would enhance 
communication throughput, use of delayed ACKs is enabled. When use of delayed ACKs 
is enabled and by monitoring the network traffic the present invention determines that 
delayed ACKs inhibit communication throughput, use of delayed ACKs is disabled. 

15 While the present invention has been particularly shown and described with 

reference to preferred embodiments thereof, it will be understood by those skilled in the 
art that various changes in form and details may be made therein without departing from 
the spirit and scope of the invention. It should be noted that methods are not necessarily 
in the order given, unless an order is necessary. 
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